Autonomous Network Defence Using Multi-Agent Reinforcement Learning and Self-Play

Early threat detection is an increasing part of the cybersecurity landscape, given the growing scale and scope of cyberattacks in the recent years. Increasing exploitation of software vulnerabilities, especially in the manufacturing sector, demonstrates the ongoing need for autonomous network defence. In this work, we model the problem as a zero-sum Markov game between an attacker and defender reinforcement learning agents. Previous methods test their approach on a single topology or limit the agents to a subset of the network. However, real world networks are rarely fixed and often add or remove hosts based on demand, link failures, outages, or other factors. We do not confine our research to a fixed network in terms of size and topology, but instead are interested in larger networks and varied topologies to determine the scalability and robustness of the approach. We consider additional topologies and a robust training curriculum that incorporates network topologies to build more general, capable agents. We also use PPO which offers a good balance of computational complexity and convergence speed

Complications with Controlling Insect Eggs

Eggs are difficult to kill because of the unique structure of the eggshell, comprised of multiple layers that have evolved to allow the embryo to breathe while simultaneously limiting water loss. The eggshell has been shown to be an excellent barrier to insecticides, fungal pathogens, and some fumigants. The insect eggshell contains only a few areas that could allow penetration of insecticides, the aeropyles and micropyles, which seem to be either so few in number or small in size that they do not allow a sufficient amount of insecticide through the eggshell. Resistance is also a contributing factor to control failures of insect eggs. Resistance in eggs has been documented in several insect species and a few studies have shown that some insect eggs produce elevated numbers of enzymes to break down insecticides. This chapter focuses on the structure and respiration of the insect eggshell as a barrier to insecticides and also covers various management strategies against insect eggs. Lastly, we discuss the few documentations of resistance in insect eggs thus far

Are Consumers Willing to Pay More for Biodegradable Containers Than for Plastic Ones? Evidence from Hypothetical Conjoint Analysis and Nonhypothetical Experimental Auctions

This study used and compared hypothetical conjoint analysis and nonhypothetical experimental auctions to elicit floral customers’ willingness to pay for biodegradable plant containers. The results of the study show that participants were willing to pay a price premium for biodegradable containers, but the premium is not the same for different types of containers. This article also shows the mixed ordered probit model generates more accurate results when analyzing the conjoint analysis Internet survey data than the ordered probit model.biodegradable, willingness to pay, marketing, carbon footprint, waste composition, green industry, nursery crops, floriculture crops, Agribusiness, Agricultural and Food Policy, Environmental Economics and Policy, Financial Economics, Food Consumption/Nutrition/Food Safety, Marketing, Public Economics, Research and Development/Tech Change/Emerging Technologies, D12, Q13,

Four-lepton production at hadron colliders: aMC@NLO predictions with theoretical uncertainties

We use aMC@NLO to study the production of four charged leptons at the LHC, performing parton showers with both HERWIG and Pythia6. Our underlying matrix element calculation features the full next-to-leading order $O(\alpha_S)$ result and the $O(\alpha_S^2)$ contribution of the $gg$ channel, and it includes all off-shell, spin-correlation, virtual-photon-exchange, and interference effects. We present several key distributions together with the corresponding theoretical uncertainties. These are obtained through a process-independent technique that allows aMC@NLO to compute scale and PDF uncertainties in a fully automated way and at no extra CPU-time costComment: 24 pages, 6 figure

Automation of one-loop QCD corrections

We present the complete automation of the computation of one-loop QCD corrections, including UV renormalization, to an arbitrary scattering process in the Standard Model. This is achieved by embedding the OPP integrand reduction technique, as implemented in CutTools, into the MadGraph framework. By interfacing the tool so constructed, which we dub MadLoop, with MadFKS, the fully automatic computation of any infrared-safe observable at the next-to-leading order in QCD is attained. We demonstrate the flexibility and the reach of our method by calculating the production rates for a variety of processes at the 7 TeV LHC.Comment: 64 pages, 12 figures. Corrected the value of m_Z in table 1. In table 2, corrected the values of cross sections in a.4 and a.5 (previously computed with mu=mtop/2 rather than mu=mtop/4). In table 2, corrected the values of NLO cross sections in b.3, b.6, c.3, and e.7 (the symmetry factor for a few virtual channels was incorrect). In sect. A.4.3, the labeling of the four-momenta was incorrec

Model-Independent Bounds on a Light Higgs

We present up-to-date constraints on a generic Higgs parameter space. An accurate assessment of these exclusions must take into account statistical, and potentially signal, fluctuations in the data currently taken at the LHC. For this, we have constructed a straightforward statistical method for making full use of the data that is publicly available. We show that, using the expected and observed exclusions which are quoted for each search channel, we can fully reconstruct likelihood profiles under very reasonable and simple assumptions. Even working with this somewhat limited information, we show that our method is sufficiently accurate to warrant its study and advocate its use over more naive prescriptions. Using this method, we can begin to narrow in on the remaining viable parameter space for a Higgs-like scalar state, and to ascertain the nature of any hints of new physics---Higgs or otherwise---appearing in the data.Comment: 32 pages, 10 figures; v3: correction made to basis of four-derivative operators in the effective Lagrangian, references adde

W and Z/gamma* boson production in association with a bottom-antibottom pair

We present a study of l\nu b\bar{b} and l+ l- b\bar{b} production at hadron colliders. Our results, accurate to the next-to-leading order in QCD, are based on automatic matrix-element calculations performed by MadLoop and MadFKS, and are given at both the parton level, and after the matching with the Herwig event generator, achieved with aMC@NLO. We retain the complete dependence on the bottom-quark mass, and include exactly all spin correlations of final-state leptons. We discuss the cases of several observables at the LHC which highlight the importance of accurate simulations.Comment: 18 pages, 12 figures. References updated, minor changes to the tex

5 Year Expression and Neutrophil Defect Repair after Gene Therapy in Alpha-1 Antitrypsin Deficiency

Alpha-1 antitrypsin deficiency is a monogenic disorder resulting in emphysema due principally to the unopposed effects of neutrophil elastase. We previously reported achieving plasma wild-type alpha-1 antitrypsin concentrations at 2.5%-3.8% of the purported therapeutic level at 1 year after a single intramuscular administration of recombinant adeno-associated virus serotype 1 alpha-1 antitrypsin vector in alpha-1 antitrypsin deficient patients. We analyzed blood and muscle for alpha-1 antitrypsin expression and immune cell response. We also assayed previously reported markers of neutrophil function known to be altered in alpha-1 antitrypsin deficient patients. Here, we report sustained expression at 2.0%-2.5% of the target level from years 1-5 in these same patients without any additional recombinant adeno-associated virus serotype-1 alpha-1 antitrypsin vector administration. In addition, we observed partial correction of disease-associated neutrophil defects, including neutrophil elastase inhibition, markers of degranulation, and membrane-bound anti-neutrophil antibodies. There was also evidence of an active T regulatory cell response (similar to the 1 year data) and an exhausted cytotoxic T cell response to adeno-associated virus serotype-1 capsid. These findings suggest that muscle-based alpha-1 antitrypsin gene replacement is tolerogenic and that stable levels of M-AAT may exert beneficial neutrophil effects at lower concentrations than previously anticipated

Phase 2 clinical trial of a recombinant adeno-associated viral vector expressing α1-antitrypsin: interim results

Recombinant adeno-associated virus (rAAV) vectors offer promise for the gene therapy of α(1)-antitrypsin (AAT) deficiency. In our prior trial, an rAAV vector expressing human AAT (rAAV1-CB-hAAT) provided sustained, vector-derived AAT expression for \u3e1 year. In the current phase 2 clinical trial, this same vector, produced by a herpes simplex virus complementation method, was administered to nine AAT-deficient individuals by intramuscular injection at doses of 6.0×10(11), 1.9×10(12), and 6.0×10(12) vector genomes/kg (n=3 subjects/dose). Vector-derived expression of normal (M-type) AAT in serum was dose dependent, peaked on day 30, and persisted for at least 90 days. Vector administration was well tolerated, with only mild injection site reactions and no serious adverse events. Serum creatine kinase was transiently elevated on day 30 in five of six subjects in the two higher dose groups and normalized by day 45. As expected, all subjects developed anti-AAV antibodies and interferon-γ enzyme-linked immunospot responses to AAV peptides, and no subjects developed antibodies to AAT. One subject in the mid-dose group developed T cell responses to a single AAT peptide unassociated with any clinical effects. Muscle biopsies obtained on day 90 showed strong immunostaining for AAT and moderate to marked inflammatory cell infiltrates composed primarily of CD3-reactive T lymphocytes that were primarily of the CD8(+) subtype. These results support the feasibility and safety of AAV gene therapy for AAT deficiency, and indicate that serum levels of vector-derived normal human AAT \u3e20 μg/ml can be achieved. However, further improvements in the design or delivery of rAAV-AAT vectors will be required to achieve therapeutic target serum AAT concentrations